| Daniel Stenberg | 4356356 | 2004-08-12 11:02:01 +0000 | [diff] [blame] | 1 | Updated: August 12, 2004 (http://curl.haxx.se/docs/faq.html) |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 2 | _ _ ____ _ |
| 3 | ___| | | | _ \| | |
| 4 | / __| | | | |_) | | |
| 5 | | (__| |_| | _ <| |___ |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 6 | \___|\___/|_| \_\_____| |
| 7 | |
| 8 | FAQ |
| 9 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 10 | 1. Philosophy |
| 11 | 1.1 What is cURL? |
| 12 | 1.2 What is libcurl? |
| 13 | 1.3 What is cURL not? |
| 14 | 1.4 When will you make curl do XXXX ? |
| Daniel Stenberg | a0eb52b | 2001-03-23 15:28:13 +0000 | [diff] [blame] | 15 | 1.5 Who makes cURL? |
| 16 | 1.6 What do you get for making cURL? |
| Daniel Stenberg | c528dc5 | 2001-08-07 11:17:37 +0000 | [diff] [blame] | 17 | 1.7 What about CURL from curl.com? |
| Daniel Stenberg | 8eaa7fe | 2002-04-27 18:12:26 +0000 | [diff] [blame] | 18 | 1.8 I have a problem who do I mail? |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 19 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 20 | 2. Install Related Problems |
| 21 | 2.1 configure doesn't find OpenSSL even when it is installed |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 22 | 2.1.1 native linker doesn't find OpenSSL |
| 23 | 2.1.2 only the libssl lib is missing |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 24 | 2.2 Does curl work/build with other SSL libraries? |
| 25 | 2.3 Where can I find a copy of LIBEAY32.DLL? |
| 26 | 2.4 Does cURL support Socks (RFC 1928) ? |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 27 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 28 | 3. Usage Problems |
| 29 | 3.1 curl: (1) SSL is disabled, https: not supported |
| 30 | 3.2 How do I tell curl to resume a transfer? |
| 31 | 3.3 Why doesn't my posting using -F work? |
| 32 | 3.4 How do I tell curl to run custom FTP commands? |
| 33 | 3.5 How can I disable the Pragma: nocache header? |
| Daniel Stenberg | 48bc73c | 2002-05-21 13:53:32 +0000 | [diff] [blame] | 34 | 3.6 Does curl support ASP, XML, XHTML or HTML version Y? |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 35 | 3.7 Can I use curl to delete/rename a file through FTP? |
| 36 | 3.8 How do I tell curl to follow HTTP redirects? |
| Daniel Stenberg | 98871d1 | 2002-05-22 22:14:03 +0000 | [diff] [blame] | 37 | 3.9 How do I use curl in my favorite programming language? |
| Daniel Stenberg | 147a673 | 2001-03-08 09:25:09 +0000 | [diff] [blame] | 38 | 3.10 What about SOAP, WebDAV, XML-RPC or similar protocols over HTTP? |
| Daniel Stenberg | 88d14e9 | 2001-05-29 14:02:20 +0000 | [diff] [blame] | 39 | 3.11 How do I POST with a different Content-Type? |
| Daniel Stenberg | 6513dce | 2001-11-27 13:34:59 +0000 | [diff] [blame] | 40 | 3.12 Why do FTP specific features over HTTP proxy fail? |
| Daniel Stenberg | 6b1a1a6 | 2002-03-11 08:29:26 +0000 | [diff] [blame] | 41 | 3.13 Why does my single/double quotes fail? |
| Daniel Stenberg | 48bc73c | 2002-05-21 13:53:32 +0000 | [diff] [blame] | 42 | 3.14 Does curl support javascript or pac (automated proxy config)? |
| Daniel Stenberg | f3e5d4a | 2003-12-22 17:24:21 +0000 | [diff] [blame] | 43 | 3.15 Can I do recursive fetches with curl? |
| Daniel Stenberg | edd16d9 | 2004-08-12 11:39:00 +0000 | [diff] [blame] | 44 | 3.16 What certificates do I need when I use SSL? |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 45 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 46 | 4. Running Problems |
| 47 | 4.1 Problems connecting to SSL servers. |
| Daniel Stenberg | e26ee09 | 2001-01-15 10:26:37 +0000 | [diff] [blame] | 48 | 4.2 Why do I get problems when I use & or % in the URL? |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 49 | 4.3 How can I use {, }, [ or ] to specify multiple URLs? |
| 50 | 4.4 Why do I get downloaded data even though the web page doesn't exist? |
| 51 | 4.5 Why do I get return code XXX from a HTTP server? |
| 52 | 4.5.1 "400 Bad Request" |
| 53 | 4.5.2 "401 Unauthorized" |
| 54 | 4.5.3 "403 Forbidden" |
| 55 | 4.5.4 "404 Not Found" |
| 56 | 4.5.5 "405 Method Not Allowed" |
| Daniel Stenberg | d60029d | 2001-12-19 23:25:04 +0000 | [diff] [blame] | 57 | 4.5.6 "301 Moved Permanently" |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 58 | 4.6 Can you tell me what error code 142 means? |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 59 | 4.7 How do I keep user names and passwords secret in Curl command lines? |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 60 | 4.8 I found a bug! |
| Daniel Stenberg | 2c10037 | 2000-12-19 07:30:51 +0000 | [diff] [blame] | 61 | 4.9 Curl can't authenticate to the server that requires NTLM? |
| Daniel Stenberg | bc74375 | 2002-05-15 21:40:29 +0000 | [diff] [blame] | 62 | 4.10 My HTTP request using HEAD, PUT or DELETE doesn't work! |
| Daniel Stenberg | 522b85a | 2002-11-12 20:00:02 +0000 | [diff] [blame] | 63 | 4.11 Why does my HTTP range requests return the full document? |
| Daniel Stenberg | 1607711 | 2002-11-20 19:17:43 +0000 | [diff] [blame] | 64 | 4.12 Why do I get "certificate verify failed" ? |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 65 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 66 | 5. libcurl Issues |
| Daniel Stenberg | 7d09e51 | 2001-01-11 12:52:07 +0000 | [diff] [blame] | 67 | 5.1 Is libcurl thread-safe? |
| Daniel Stenberg | a40b55d | 2000-11-22 07:27:26 +0000 | [diff] [blame] | 68 | 5.2 How can I receive all data into a large memory chunk? |
| Daniel Stenberg | 2c10037 | 2000-12-19 07:30:51 +0000 | [diff] [blame] | 69 | 5.3 How do I fetch multiple files with libcurl? |
| Daniel Stenberg | 910fc85 | 2000-12-30 11:48:51 +0000 | [diff] [blame] | 70 | 5.4 Does libcurl do Winsock initing on win32 systems? |
| Daniel Stenberg | 7e3cd82 | 2003-12-08 13:59:35 +0000 | [diff] [blame] | 71 | 5.5 Does CURLOPT_WRITEDATA and CURLOPT_READDATA work on win32 ? |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 72 | 5.6 What about Keep-Alive or persistent connections? |
| Daniel Stenberg | dd82d69 | 2002-10-08 07:16:17 +0000 | [diff] [blame] | 73 | 5.7 Link errors when building libcurl on Windows! |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 74 | 5.8 libcurl.so.3: open failed: No such file or directory |
| Daniel Stenberg | 1d32336 | 2004-08-12 14:09:10 +0000 | [diff] [blame] | 75 | 5.9 How does libcurl resolve host names? |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 76 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 77 | 6. License Issues |
| 78 | 6.1 I have a GPL program, can I use the libcurl library? |
| 79 | 6.2 I have a closed-source program, can I use the libcurl library? |
| Daniel Stenberg | 31b8eea | 2000-08-23 07:27:00 +0000 | [diff] [blame] | 80 | 6.3 I have a BSD licensed program, can I use the libcurl library? |
| 81 | 6.4 I have a program that uses LGPL libraries, can I use libcurl? |
| 82 | 6.5 Can I modify curl/libcurl for my program and keep the changes secret? |
| 83 | 6.6 Can you please change the curl/libcurl license to XXXX? |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 84 | |
| 85 | ============================================================================== |
| 86 | |
| 87 | 1. Philosophy |
| 88 | |
| 89 | 1.1 What is cURL? |
| 90 | |
| 91 | cURL (or simply just 'curl') is a command line tool for getting or sending |
| 92 | files using URL syntax. The name is a play on 'Client for URLs', originally |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 93 | with URL spelled in uppercase to make it obvious it deals with URLs. The |
| Daniel Stenberg | d16c757 | 2002-08-08 11:54:11 +0000 | [diff] [blame] | 94 | fact it can also be pronounced 'see URL' also helped, it works as an |
| 95 | abbrivation for "Client URL Request Library" or why not the recursive |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 96 | version: "Curl URL Request Library". |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 97 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 98 | Curl supports a range of common Internet protocols, currently including |
| Daniel Stenberg | d73d28a | 2001-08-23 11:12:07 +0000 | [diff] [blame] | 99 | HTTP, HTTPS, FTP, FTPS, GOPHER, LDAP, DICT, TELNET and FILE. |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 100 | |
| Daniel Stenberg | 8e7b261 | 2001-03-22 11:23:48 +0000 | [diff] [blame] | 101 | We spell it cURL or just curl. We pronounce it with an initial k sound: |
| 102 | [kurl]. |
| Daniel Stenberg | 887e728 | 2001-01-03 09:13:07 +0000 | [diff] [blame] | 103 | |
| Daniel Stenberg | 073ef0b | 2003-05-09 07:07:13 +0000 | [diff] [blame] | 104 | NOTE: there are numerous sub-projects and related projects that also use the |
| 105 | word curl in the project names in various combinations, but you should take |
| 106 | notice that this FAQ is directed at the command-line tool named curl (and |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 107 | libcurl the library), and may therefore not be valid for other curl-related |
| Daniel Stenberg | 073ef0b | 2003-05-09 07:07:13 +0000 | [diff] [blame] | 108 | projects. |
| 109 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 110 | 1.2 What is libcurl? |
| 111 | |
| Daniel Stenberg | bc5954f | 2001-03-23 08:16:24 +0000 | [diff] [blame] | 112 | libcurl is a reliable and portable library which provides you with an easy |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 113 | interface to a range of common Internet protocols. |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 114 | |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 115 | You can use libcurl for free in your application, be it open source, |
| 116 | commercial or closed-source. |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 117 | |
| 118 | 1.3 What is cURL not? |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 119 | |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 120 | Curl is *not* a wget clone. That is a common misconception. Never, during |
| 121 | curl's development, have we intended curl to replace wget or compete on its |
| 122 | market. Curl is targeted at single-shot file transfers. |
| 123 | |
| 124 | Curl is not a web site mirroring program. If you want to use curl to mirror |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 125 | something: fine, go ahead and write a script that wraps around curl to make |
| 126 | it reality (like curlmirror.pl does). |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 127 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 128 | Curl is not an FTP site mirroring program. Sure, get and send FTP with curl |
| 129 | but if you want systematic and sequential behavior you should write a |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 130 | script (or write a new program that interfaces libcurl) and do it. |
| 131 | |
| 132 | Curl is not a PHP tool, even though it works perfectly well when used from |
| 133 | or with PHP. |
| 134 | |
| Daniel Stenberg | 31b8eea | 2000-08-23 07:27:00 +0000 | [diff] [blame] | 135 | Curl is not a single-OS program. Curl exists, compiles, builds and runs |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 136 | under a wide range of operating systems, including all modern Unixes (and a |
| 137 | bunch of older ones too), Windows, Amiga, BeOS, OS/2, OS X, QNX etc. |
| Daniel Stenberg | 31b8eea | 2000-08-23 07:27:00 +0000 | [diff] [blame] | 138 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 139 | 1.4 When will you make curl do XXXX ? |
| 140 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 141 | We love suggestions of what to change in order to make curl and libcurl |
| 142 | better. We do however believe in a few rules when it comes to the future of |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 143 | curl: |
| 144 | |
| Daniel Stenberg | 073ef0b | 2003-05-09 07:07:13 +0000 | [diff] [blame] | 145 | * Curl -- the command line tool -- is to remain a non-graphical command line |
| 146 | tool. If you want GUIs or fancy scripting capabilities, you should look |
| 147 | for another tool that uses libcurl. |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 148 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 149 | * We do not add things to curl that other small and available tools already |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 150 | do very fine at the side. Curl's output is fine to pipe into another |
| 151 | program or redirect to another file for the next program to interpret. |
| 152 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 153 | * We focus on protocol related issues and improvements. If you wanna do more |
| Daniel Stenberg | 5f8e93d | 2000-10-25 07:41:58 +0000 | [diff] [blame] | 154 | magic with the supported protocols than curl currently does, chances are |
| Daniel Stenberg | 7d24ce9 | 2001-11-01 09:12:35 +0000 | [diff] [blame] | 155 | big we will agree. If you wanna add more protocols, we may very well |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 156 | agree. |
| 157 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 158 | * If you want someone else to make all the work while you wait for us to |
| 159 | implement it for you, that is not a very friendly attitude. We spend a |
| 160 | considerable time already on maintaining and developing curl. In order to |
| 161 | get more out of us, you should consider trading in some of your time and |
| 162 | efforts in return. |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 163 | |
| 164 | * If you write the code, chances are bigger that it will get into curl |
| 165 | faster. |
| 166 | |
| Daniel Stenberg | a0eb52b | 2001-03-23 15:28:13 +0000 | [diff] [blame] | 167 | 1.5 Who makes cURL? |
| 168 | |
| 169 | cURL and libcurl are not made by any single individual. Sure, Daniel |
| Daniel Stenberg | d16c757 | 2002-08-08 11:54:11 +0000 | [diff] [blame] | 170 | Stenberg writes the major parts, but other persons' submissions are |
| 171 | important and crucial. Anyone can contribute and post their changes and |
| 172 | improvements and have them inserted in the main sources (of course on the |
| 173 | condition that developers agree on that the fixes are good). |
| Daniel Stenberg | a0eb52b | 2001-03-23 15:28:13 +0000 | [diff] [blame] | 174 | |
| Daniel Stenberg | 81f2246 | 2001-11-27 13:33:21 +0000 | [diff] [blame] | 175 | The list of contributors in the docs/THANKS file is only a small part of all |
| 176 | the people that every day provide us with bug reports, suggestions, ideas |
| 177 | and source code. |
| Daniel Stenberg | a0eb52b | 2001-03-23 15:28:13 +0000 | [diff] [blame] | 178 | |
| 179 | curl is developed by a community, with Daniel at the wheel. |
| 180 | |
| 181 | 1.6 What do you get for making cURL? |
| 182 | |
| Daniel Stenberg | d16c757 | 2002-08-08 11:54:11 +0000 | [diff] [blame] | 183 | Project cURL is entirely free and open. No person gets paid for developing |
| 184 | curl. We do this voluntarily on our spare time. |
| Daniel Stenberg | a0eb52b | 2001-03-23 15:28:13 +0000 | [diff] [blame] | 185 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 186 | We get some help from companies. Contactor Data hosts the curl web site, |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 187 | Haxx owns the curl web site's domain and sourceforge.net hosts project |
| 188 | services we take advantage from, like the bug tracker. |
| Daniel Stenberg | a0eb52b | 2001-03-23 15:28:13 +0000 | [diff] [blame] | 189 | |
| Daniel Stenberg | d370681 | 2001-11-27 13:37:29 +0000 | [diff] [blame] | 190 | If you want to support our project with a donation or similar, one way of |
| Daniel Stenberg | 25fe47f | 2001-11-14 20:13:38 +0000 | [diff] [blame] | 191 | doing that would be to buy "gift certificates" at useful online shopping |
| 192 | sites, such as amazon.com or thinkgeek.com. Another way would be to sponsor |
| Daniel Stenberg | d16c757 | 2002-08-08 11:54:11 +0000 | [diff] [blame] | 193 | us through a banner-program or even better: by helping us coding, |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 194 | documenting, testing etc. You're welcome to send us a buck using paypal, as |
| 195 | described here: http://curl.haxx.se/donation.html |
| Daniel Stenberg | c528dc5 | 2001-08-07 11:17:37 +0000 | [diff] [blame] | 196 | |
| 197 | 1.7 What about CURL from curl.com? |
| 198 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 199 | During the summer 2001, curl.com was busy advertising their client-side |
| Daniel Stenberg | c528dc5 | 2001-08-07 11:17:37 +0000 | [diff] [blame] | 200 | programming language for the web, named CURL. |
| 201 | |
| Daniel Stenberg | 81b6ebc | 2001-08-07 18:02:37 +0000 | [diff] [blame] | 202 | We are in no way associated with curl.com or their CURL programming |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 203 | language. |
| Daniel Stenberg | c528dc5 | 2001-08-07 11:17:37 +0000 | [diff] [blame] | 204 | |
| Daniel Stenberg | 81b6ebc | 2001-08-07 18:02:37 +0000 | [diff] [blame] | 205 | Our project name curl has been in effective use since 1998. We were not the |
| Daniel Stenberg | 4045cd5 | 2001-08-07 21:21:24 +0000 | [diff] [blame] | 206 | first computer related project to use the name "curl" and do not claim any |
| Daniel Stenberg | 81b6ebc | 2001-08-07 18:02:37 +0000 | [diff] [blame] | 207 | first-hand rights to the name. |
| Daniel Stenberg | c528dc5 | 2001-08-07 11:17:37 +0000 | [diff] [blame] | 208 | |
| Daniel Stenberg | 81b6ebc | 2001-08-07 18:02:37 +0000 | [diff] [blame] | 209 | We recognize that we will be living in parallel with curl.com and wish them |
| 210 | every success. |
| Daniel Stenberg | c528dc5 | 2001-08-07 11:17:37 +0000 | [diff] [blame] | 211 | |
| Daniel Stenberg | 8eaa7fe | 2002-04-27 18:12:26 +0000 | [diff] [blame] | 212 | 1.8 I have a problem who do I mail? |
| 213 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 214 | Please do not mail any single individual unless you really need to. Keep |
| 215 | curl-related questions on a suitable mailing list. All available mailing |
| 216 | lists are listed in the MANUAL document and online at |
| Daniel Stenberg | 8eaa7fe | 2002-04-27 18:12:26 +0000 | [diff] [blame] | 217 | http://curl.haxx.se/mail/ |
| 218 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 219 | Keeping curl-related questions and discussions on mailing lists allows |
| 220 | others to join in and help, to share their ideas, contribute their |
| 221 | suggestions and spread their wisdom. Keeping discussions on public mailing |
| 222 | lists also allows for others to learn from this (both current and future |
| 223 | users thanks to the web based archives of the mailing lists), thus saving us |
| 224 | from having to repeat ourselves even more. Thanks for respecting this. |
| Daniel Stenberg | 8eaa7fe | 2002-04-27 18:12:26 +0000 | [diff] [blame] | 225 | |
| 226 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 227 | 2. Install Related Problems |
| 228 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 229 | 2.1 configure doesn't find OpenSSL even when it is installed |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 230 | |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 231 | This may be because of several reasons. |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 232 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 233 | 2.1.1 native linker doesn't find openssl |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 234 | |
| Daniel Stenberg | bfb1690 | 2000-08-17 11:42:59 +0000 | [diff] [blame] | 235 | Affected platforms: |
| 236 | Solaris (native cc compiler) |
| 237 | HPUX (native cc compiler) |
| 238 | SGI IRIX (native cc compiler) |
| Daniel Stenberg | 13962ad | 2000-09-28 10:26:44 +0000 | [diff] [blame] | 239 | SCO UNIX (native cc compiler) |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 240 | |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 241 | When configuring curl, I specify --with-ssl. OpenSSL is installed in |
| 242 | /usr/local/ssl Configure reports SSL in /usr/local/ssl, but fails to find |
| 243 | CRYPTO_lock in -lcrypto |
| Daniel Stenberg | 7c37c6a | 2000-05-22 17:35:35 +0000 | [diff] [blame] | 244 | |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 245 | Cause: The cc for this test places the -L/usr/local/ssl/lib AFTER |
| 246 | -lcrypto, so ld can't find the library. This is due to a bug in the GNU |
| 247 | autoconf tool. |
| 248 | |
| 249 | Workaround: Specifying "LDFLAGS=-L/usr/local/ssl/lib" in front of |
| 250 | ./configure places the -L/usr/local/ssl/lib early enough in the command |
| 251 | line to make things work |
| 252 | |
| Daniel Stenberg | bfb1690 | 2000-08-17 11:42:59 +0000 | [diff] [blame] | 253 | Solution submitted by: Bob Allison <allisonb@users.sourceforge.net> |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 254 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 255 | 2.1.2 only the libssl lib is missing |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 256 | |
| 257 | If all include files and the libcrypto lib is present, with only the |
| 258 | libssl being missing according to configure, this is mostly likely because |
| 259 | a few functions are left out from the libssl. |
| 260 | |
| 261 | If the function names missing include RSA or RSAREF you can be certain |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 262 | that this is because libssl requires the RSA and RSAREF libs to build. |
| Daniel Stenberg | ef34ad2 | 2000-06-02 12:45:23 +0000 | [diff] [blame] | 263 | |
| 264 | See the INSTALL file section that explains how to add those libs to |
| 265 | configure. Make sure that you remove the config.cache file before you |
| 266 | rerun configure with the new flags. |
| 267 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 268 | 2.2 Does curl work/build with other SSL libraries? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 269 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 270 | Curl has been written to use OpenSSL, although there should not be much |
| Daniel Stenberg | 26d1aac | 2001-02-16 13:41:09 +0000 | [diff] [blame] | 271 | problems using a different library. If anyone does "port" curl to use a |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 272 | different SSL library, we are of course very interested in getting the |
| 273 | patch! |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 274 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 275 | 2.3 Where can I find a copy of LIBEAY32.DLL? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 276 | |
| 277 | That is an OpenSSL binary built for Windows. |
| 278 | |
| 279 | Curl uses OpenSSL to do the SSL stuff. The LIBEAY32.DLL is what curl needs |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 280 | on a windows machine to do https://. Check out the curl web site to find |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 281 | accurate and up-to-date pointers to recent OpenSSL DLLs and other binary |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 282 | packages. |
| 283 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 284 | 2.4 Does cURL support Socks (RFC 1928) ? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 285 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 286 | Yes, SOCKS5 is supported. |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 287 | |
| 288 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 289 | 3. Usage problems |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 290 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 291 | 3.1 curl: (1) SSL is disabled, https: not supported |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 292 | |
| 293 | If you get this output when trying to get anything from a https:// server, |
| 294 | it means that the configure script couldn't find all libs and include files |
| 295 | it requires for SSL to work. If the configure script fails to find them, |
| 296 | curl is simply built without SSL support. |
| 297 | |
| 298 | To get the https:// support into a curl that was previously built but that |
| 299 | reports that https:// is not supported, you should dig through the document |
| 300 | and logs and check out why the configure script doesn't find the SSL libs |
| 301 | and/or include files. |
| 302 | |
| 303 | Also, check out the other paragraph in this FAQ labeled "configure doesn't |
| 304 | find OpenSSL even when it is installed". |
| 305 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 306 | 3.2 How do I tell curl to resume a transfer? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 307 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 308 | Curl supports resumed transfers both ways on both FTP and HTTP. |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 309 | |
| Daniel Stenberg | 887e728 | 2001-01-03 09:13:07 +0000 | [diff] [blame] | 310 | Try the -C option. |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 311 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 312 | 3.3 Why doesn't my posting using -F work? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 313 | |
| 314 | You can't simply use -F or -d at your choice. The web server that will |
| 315 | receive your post assumes one of the formats. If the form you're trying to |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 316 | "fake" sets the type to 'multipart/form-data', then and only then you must |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 317 | use the -F type. In all the most common cases, you should use -d which then |
| 318 | causes a posting with the type 'application/x-www-form-urlencoded'. |
| 319 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 320 | This is described in some detail in the MANUAL and TheArtOfHttpScripting |
| 321 | documents, and if you don't understand it the first time, read it again |
| 322 | before you post questions about this to the mailing list. Also, try reading |
| 323 | through the mailing list archives for old postings and questions regarding |
| 324 | this. |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 325 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 326 | 3.4 How do I tell curl to run custom FTP commands? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 327 | |
| 328 | You can tell curl to perform optional commands both before and/or after a |
| 329 | file transfer. Study the -Q/--quote option. |
| 330 | |
| 331 | Since curl is used for file transfers, you don't use curl to just perform |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 332 | FTP commands without transferring anything. Therefore you must always specify |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 333 | a URL to transfer to/from even when doing custom FTP commands. |
| 334 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 335 | 3.5 How can I disable the Pragma: nocache header? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 336 | |
| 337 | You can change all internally generated headers by adding a replacement with |
| 338 | the -H/--header option. By adding a header with empty contents you safely |
| 339 | disable that one. Use -H "Pragma:" to disable that specific header. |
| 340 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 341 | 3.6 Does curl support ASP, XML, XHTML or HTML version Y? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 342 | |
| 343 | To curl, all contents are alike. It doesn't matter how the page was |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 344 | generated. It may be ASP, PHP, Perl, shell-script, SSI or plain |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 345 | HTML-files. There's no difference to curl and it doesn't even know what kind |
| 346 | of language that generated the page. |
| 347 | |
| Daniel Stenberg | 2080738 | 2002-05-21 14:00:55 +0000 | [diff] [blame] | 348 | See also item 3.14 regarding javascript. |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 349 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 350 | 3.7 Can I use curl to delete/rename a file through FTP? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 351 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 352 | Yes. You specify custom FTP commands with -Q/--quote. |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 353 | |
| 354 | One example would be to delete a file after you have downloaded it: |
| 355 | |
| 356 | curl -O ftp://download.com/coolfile -Q '-DELE coolfile' |
| 357 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 358 | 3.8 How do I tell curl to follow HTTP redirects? |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 359 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 360 | Curl does not follow so-called redirects by default. The Location: header |
| 361 | that informs the client about this is only interpreted if you're using the |
| 362 | -L/--location option. As in: |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 363 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 364 | curl -L http://redirector.com |
| 365 | |
| Daniel Stenberg | 98871d1 | 2002-05-22 22:14:03 +0000 | [diff] [blame] | 366 | 3.9 How do I use curl in my favorite programming language? |
| Daniel Stenberg | 368e352 | 2001-01-29 10:16:21 +0000 | [diff] [blame] | 367 | |
| Daniel Stenberg | dfdf491 | 2001-12-21 09:20:04 +0000 | [diff] [blame] | 368 | There exist many language interfaces/bindings for curl that integrates it |
| 369 | better with various languages. If you are fluid in a script language, you |
| 370 | may very well opt to use such an interface instead of using the command line |
| 371 | tool. |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 372 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 373 | Find out more about which languages that support curl directly, and how to |
| 374 | install and use them, in the libcurl section of the curl web site: |
| Daniel Stenberg | 17de7e0 | 2004-08-10 12:41:44 +0000 | [diff] [blame] | 375 | http://curl.haxx.se/libcurl/ |
| Daniel Stenberg | 368e352 | 2001-01-29 10:16:21 +0000 | [diff] [blame] | 376 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 377 | In February 2003, there are interfaces available for the following |
| 378 | languages: Basic, C, C++, Cocoa, Dylan, Euphoria, Java, Lua, Object-Pascal, |
| 379 | Pascal, Perl, PHP, PostgreSQL, Python, Rexx, Ruby, Scheme and Tcl. By the |
| 380 | time you read this, additional ones may have appeared! |
| Daniel Stenberg | 368e352 | 2001-01-29 10:16:21 +0000 | [diff] [blame] | 381 | |
| Daniel Stenberg | 147a673 | 2001-03-08 09:25:09 +0000 | [diff] [blame] | 382 | 3.10 What about SOAP, WebDAV, XML-RPC or similar protocols over HTTP? |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 383 | |
| 384 | Curl adheres to the HTTP spec, which basically means you can play with *any* |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 385 | protocol that is built on top of HTTP. Protocols such as SOAP, WEBDAV and |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 386 | XML-RPC are all such ones. You can use -X to set custom requests and -H to |
| 387 | set custom headers (or replace internally generated ones). |
| 388 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 389 | Using libcurl is of course just as fine and you'd just use the proper |
| 390 | library options to do the same. |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 391 | |
| Daniel Stenberg | 88d14e9 | 2001-05-29 14:02:20 +0000 | [diff] [blame] | 392 | 3.11 How do I POST with a different Content-Type? |
| 393 | |
| 394 | You can always replace the internally generated headers with -H/--header. |
| 395 | To make a simple HTTP POST with text/xml as content-type, do something like: |
| 396 | |
| 397 | curl -d "datatopost" -H "Content-Type: text/xml" [URL] |
| 398 | |
| Daniel Stenberg | 50e9f8f | 2001-10-23 10:12:28 +0000 | [diff] [blame] | 399 | 3.12 Why do FTP specific features over HTTP proxy fail? |
| Daniel Stenberg | 7d3daa5 | 2001-10-23 10:12:00 +0000 | [diff] [blame] | 400 | |
| 401 | Because when you use a HTTP proxy, the protocol spoken on the network will |
| 402 | be HTTP, even if you specify a FTP URL. This effectively means that you |
| Daniel Stenberg | 98871d1 | 2002-05-22 22:14:03 +0000 | [diff] [blame] | 403 | normally can't use FTP specific features such as FTP upload and FTP quote |
| Daniel Stenberg | 7d3daa5 | 2001-10-23 10:12:00 +0000 | [diff] [blame] | 404 | etc. |
| 405 | |
| 406 | There is one exception to this rule, and that is if you can "tunnel through" |
| Daniel Stenberg | 271f96f | 2001-11-20 08:03:01 +0000 | [diff] [blame] | 407 | the given HTTP proxy. Proxy tunneling is enabled with a special option (-p) |
| Daniel Stenberg | 97a8c98 | 2001-12-21 08:10:34 +0000 | [diff] [blame] | 408 | and is generally not available as proxy admins usually disable tunneling to |
| Daniel Stenberg | 7d3daa5 | 2001-10-23 10:12:00 +0000 | [diff] [blame] | 409 | other ports than 443 (which is used for HTTPS access through proxies). |
| 410 | |
| Daniel Stenberg | 6b1a1a6 | 2002-03-11 08:29:26 +0000 | [diff] [blame] | 411 | 3.13 Why does my single/double quotes fail? |
| 412 | |
| 413 | To specify a command line option that includes spaces, you might need to |
| 414 | put the entire option within quotes. Like in: |
| 415 | |
| 416 | curl -d " with spaces " url.com |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 417 | |
| Daniel Stenberg | 6b1a1a6 | 2002-03-11 08:29:26 +0000 | [diff] [blame] | 418 | or perhaps |
| 419 | |
| 420 | curl -d ' with spaces ' url.com |
| 421 | |
| 422 | Exactly what kind of quotes and how to do this is entirely up to the shell |
| Daniel Stenberg | 98871d1 | 2002-05-22 22:14:03 +0000 | [diff] [blame] | 423 | or command line interpreter that you are using. For most unix shells, you |
| Daniel Stenberg | 6b1a1a6 | 2002-03-11 08:29:26 +0000 | [diff] [blame] | 424 | can more or less pick either single (') or double (") quotes. For |
| 425 | Windows/DOS prompts I believe you're forced to use double (") quotes. |
| 426 | |
| Daniel Stenberg | 98871d1 | 2002-05-22 22:14:03 +0000 | [diff] [blame] | 427 | Please study the documentation for your particular environment. Examples in |
| Daniel Stenberg | 6b1a1a6 | 2002-03-11 08:29:26 +0000 | [diff] [blame] | 428 | the curl docs will use a mix of both these ones as shown above. You must |
| 429 | adjust them to work in your environment. |
| 430 | |
| Daniel Stenberg | 61f6284 | 2002-03-11 08:39:00 +0000 | [diff] [blame] | 431 | Remember that curl works and runs on more operating systems than most single |
| Daniel Stenberg | 6b1a1a6 | 2002-03-11 08:29:26 +0000 | [diff] [blame] | 432 | individuals have ever tried. |
| 433 | |
| Daniel Stenberg | 48bc73c | 2002-05-21 13:53:32 +0000 | [diff] [blame] | 434 | 3.14 Does curl support javascript or pac (automated proxy config)? |
| 435 | |
| 436 | Many web pages do magic stuff using embedded javascript. Curl and libcurl |
| 437 | have no built-in support for that, so it will be treated just like any other |
| 438 | contents. |
| 439 | |
| 440 | .pac files are a netscape invention and are sometimes used by organizations |
| 441 | to allow them to differentiate which proxies to use. The .pac contents is |
| 442 | just a javascript program that gets invoked by the browser and that returns |
| 443 | the name of the proxy to connect to. Since curl doesn't support javascript, |
| 444 | it can't support .pac proxy configuration either. |
| 445 | |
| 446 | Some work-arounds usually suggested to overcome this javascript dependency: |
| 447 | |
| Daniel Stenberg | 17de7e0 | 2004-08-10 12:41:44 +0000 | [diff] [blame] | 448 | - Depending on the javascript complexity, write up a script that |
| 449 | translates it to another language and execute that. |
| Daniel Stenberg | 48bc73c | 2002-05-21 13:53:32 +0000 | [diff] [blame] | 450 | |
| Daniel Stenberg | 17de7e0 | 2004-08-10 12:41:44 +0000 | [diff] [blame] | 451 | - Read the javascript code and rewrite the same logic in another language. |
| Daniel Stenberg | 48bc73c | 2002-05-21 13:53:32 +0000 | [diff] [blame] | 452 | |
| Daniel Stenberg | 17de7e0 | 2004-08-10 12:41:44 +0000 | [diff] [blame] | 453 | - Implement a javascript interpreter, people have successfully used the |
| 454 | Mozilla javascript engine in the past. |
| Daniel Stenberg | 48bc73c | 2002-05-21 13:53:32 +0000 | [diff] [blame] | 455 | |
| Daniel Stenberg | 17de7e0 | 2004-08-10 12:41:44 +0000 | [diff] [blame] | 456 | - Ask your admins to stop this, for a static proxy setup or similar. |
| Daniel Stenberg | 48bc73c | 2002-05-21 13:53:32 +0000 | [diff] [blame] | 457 | |
| Daniel Stenberg | f3e5d4a | 2003-12-22 17:24:21 +0000 | [diff] [blame] | 458 | 3.15 Can I do recursive fetches with curl? |
| 459 | |
| 460 | No. curl itself has no code that performs recursive operations, such as |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 461 | those performed by wget and similar tools. |
| Daniel Stenberg | f3e5d4a | 2003-12-22 17:24:21 +0000 | [diff] [blame] | 462 | |
| 463 | There exist wrapper scripts with that functionality (for example the |
| 464 | curlmirror perl script), and you can write programs based on libcurl to do |
| 465 | it, but the command line tool curl itself cannot. |
| Daniel Stenberg | 6b1a1a6 | 2002-03-11 08:29:26 +0000 | [diff] [blame] | 466 | |
| Daniel Stenberg | edd16d9 | 2004-08-12 11:39:00 +0000 | [diff] [blame] | 467 | 3.16 What certificates do I need when I use SSL? |
| Daniel Stenberg | 4356356 | 2004-08-12 11:02:01 +0000 | [diff] [blame] | 468 | |
| 469 | There are three different kinds of "certificates" to keep track of when we |
| 470 | talk about using SSL-based protocols (HTTPS or FTPS) using curl or libcurl. |
| 471 | |
| 472 | - Client certificate. The server you communicate may require that you can |
| 473 | provide this in order to prove that you actually are who you claim to be. |
| 474 | If the server doesn't require this, you don't need a client certificate. |
| 475 | |
| 476 | - Server certificate. The server you communicate with has a server |
| 477 | certificate. You can and should verify this certficate to make sure that |
| 478 | you are truly talking to the real server and not a server impersonating |
| 479 | it. The server certificate verifaction process is made by using a |
| 480 | Certificate Authority certificate ("CA cert") that was used to sign the |
| 481 | server certificate. Server certificate verification is enabled by default |
| 482 | in curl and libcurl and is often the reason for problems as explained in |
| 483 | FAQ entry 4.12 and the SSLCERTS document |
| 484 | (http://curl.haxx.se/docs/sslcerts.html). Server certificates that are |
| 485 | "self-signed" or otherwise signed by a CA that you do not have a CA cert |
| 486 | for, cannot be verified. If the verification during a connect fails, you |
| 487 | are refused access. You then need to explicitly disable the verification |
| 488 | to connect to the server. |
| 489 | |
| 490 | - Certificate Authority certificate ("CA cert"). You often have several CA |
| 491 | certs in a CA cert bundle that can be used to verify a server certificate |
| 492 | that was signed by one of the authorities in the bundle. curl comes with a |
| 493 | default CA cert bundle. You can override the default. |
| 494 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 495 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 496 | 4. Running Problems |
| 497 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 498 | 4.1 Problems connecting to SSL servers. |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 499 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 500 | It took a very long time before we could sort out why curl had problems to |
| 501 | connect to certain SSL servers when using SSLeay or OpenSSL v0.9+. The |
| 502 | error sometimes showed up similar to: |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 503 | |
| 504 | 16570:error:1407D071:SSL routines:SSL2_READ:bad mac decode:s2_pkt.c:233: |
| 505 | |
| 506 | It turned out to be because many older SSL servers don't deal with SSLv3 |
| 507 | requests properly. To correct this problem, tell curl to select SSLv2 from |
| 508 | the command line (-2/--sslv2). |
| 509 | |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 510 | There have also been examples where the remote server didn't like the SSLv2 |
| Daniel Stenberg | e9640b6 | 2000-08-02 07:17:56 +0000 | [diff] [blame] | 511 | request and instead you had to force curl to use SSLv3 with -3/--sslv3. |
| 512 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 513 | 4.2 Why do I get problems when I use & or % in the URL? |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 514 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 515 | In general unix shells, the & letter is treated special and when used, it |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 516 | runs the specified command in the background. To safely send the & as a part |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 517 | of a URL, you should quote the entire URL by using single (') or double (") |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 518 | quotes around it. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 519 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 520 | An example that would invoke a remote CGI that uses &-letters could be: |
| Daniel Stenberg | 8f03732 | 2000-06-06 14:09:01 +0000 | [diff] [blame] | 521 | |
| Daniel Stenberg | edcd5df | 2000-06-06 14:13:36 +0000 | [diff] [blame] | 522 | curl 'http://www.altavista.com/cgi-bin/query?text=yes&q=curl' |
| Daniel Stenberg | 8f03732 | 2000-06-06 14:09:01 +0000 | [diff] [blame] | 523 | |
| Daniel Stenberg | daf5570 | 2002-08-29 07:05:31 +0000 | [diff] [blame] | 524 | In Windows, the standard DOS shell treats the %-letter specially and you |
| 525 | need to use TWO %-letters for each single one you want to use in the URL. |
| Daniel Stenberg | e26ee09 | 2001-01-15 10:26:37 +0000 | [diff] [blame] | 526 | |
| Daniel Stenberg | 1b77c18 | 2001-01-29 10:24:51 +0000 | [diff] [blame] | 527 | Also note that if you want the literal %-letter to be part of the data you |
| Daniel Stenberg | daf5570 | 2002-08-29 07:05:31 +0000 | [diff] [blame] | 528 | pass in a POST using -d/--data you must encode it as '%25' (which then also |
| 529 | needs the %-letter doubled on Windows machines). |
| Daniel Stenberg | 1b77c18 | 2001-01-29 10:24:51 +0000 | [diff] [blame] | 530 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 531 | 4.3 How can I use {, }, [ or ] to specify multiple URLs? |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 532 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 533 | Because those letters have a special meaning to the shell, and to be used in |
| 534 | a URL specified to curl you must quote them. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 535 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 536 | An example that downloads two URLs (sequentially) would do: |
| Daniel Stenberg | 8f03732 | 2000-06-06 14:09:01 +0000 | [diff] [blame] | 537 | |
| Daniel Stenberg | edcd5df | 2000-06-06 14:13:36 +0000 | [diff] [blame] | 538 | curl '{curl,www}.haxx.se' |
| Daniel Stenberg | 8f03732 | 2000-06-06 14:09:01 +0000 | [diff] [blame] | 539 | |
| Daniel Stenberg | e26ee09 | 2001-01-15 10:26:37 +0000 | [diff] [blame] | 540 | To be able to use those letters as actual parts of the URL (without using |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 541 | them for the curl URL "globbing" system), use the -g/--globoff option: |
| Daniel Stenberg | e26ee09 | 2001-01-15 10:26:37 +0000 | [diff] [blame] | 542 | |
| 543 | curl -g 'www.site.com/weirdname[].html' |
| 544 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 545 | 4.4 Why do I get downloaded data even though the web page doesn't exist? |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 546 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 547 | Curl asks remote servers for the page you specify. If the page doesn't exist |
| 548 | at the server, the HTTP protocol defines how the server should respond and |
| 549 | that means that headers and a "page" will be returned. That's simply how |
| 550 | HTTP works. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 551 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 552 | By using the --fail option you can tell curl explicitly to not get any data |
| 553 | if the HTTP return code doesn't say success. |
| Daniel Stenberg | 8f03732 | 2000-06-06 14:09:01 +0000 | [diff] [blame] | 554 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 555 | 4.5 Why do I get return code XXX from a HTTP server? |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 556 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 557 | RFC2616 clearly explains the return codes. This is a short transcript. Go |
| 558 | read the RFC for exact details: |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 559 | |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 560 | 4.5.1 "400 Bad Request" |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 561 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 562 | The request could not be understood by the server due to malformed |
| 563 | syntax. The client SHOULD NOT repeat the request without modifications. |
| 564 | |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 565 | 4.5.2 "401 Unauthorized" |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 566 | |
| 567 | The request requires user authentication. |
| 568 | |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 569 | 4.5.3 "403 Forbidden" |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 570 | |
| 571 | The server understood the request, but is refusing to fulfill it. |
| 572 | Authorization will not help and the request SHOULD NOT be repeated. |
| 573 | |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 574 | 4.5.4 "404 Not Found" |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 575 | |
| 576 | The server has not found anything matching the Request-URI. No indication |
| 577 | is given of whether the condition is temporary or permanent. |
| 578 | |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 579 | 4.5.5 "405 Method Not Allowed" |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 580 | |
| 581 | The method specified in the Request-Line is not allowed for the resource |
| 582 | identified by the Request-URI. The response MUST include an Allow header |
| 583 | containing a list of valid methods for the requested resource. |
| 584 | |
| Daniel Stenberg | d60029d | 2001-12-19 23:25:04 +0000 | [diff] [blame] | 585 | 4.5.6 "301 Moved Permanently" |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 586 | |
| Daniel Stenberg | 98871d1 | 2002-05-22 22:14:03 +0000 | [diff] [blame] | 587 | If you get this return code and an HTML output similar to this: |
| Daniel Stenberg | d60029d | 2001-12-19 23:25:04 +0000 | [diff] [blame] | 588 | |
| 589 | <H1>Moved Permanently</H1> The document has moved <A |
| 590 | HREF="http://same_url_now_with_a_trailing_slash/">here</A>. |
| 591 | |
| 592 | it might be because you request a directory URL but without the trailing |
| 593 | slash. Try the same operation again _with_ the trailing URL, or use the |
| 594 | -L/--location option to follow the redirection. |
| 595 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 596 | 4.6 Can you tell me what error code 142 means? |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 597 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 598 | All error codes that are larger than the highest documented error code means |
| Daniel Stenberg | 13bf964 | 2001-08-23 11:11:13 +0000 | [diff] [blame] | 599 | that curl has exited due to a crash. This is a serious error, and we |
| Daniel Stenberg | 25fe47f | 2001-11-14 20:13:38 +0000 | [diff] [blame] | 600 | appreciate a detailed bug report from you that describes how we could go |
| Daniel Stenberg | 13bf964 | 2001-08-23 11:11:13 +0000 | [diff] [blame] | 601 | ahead and repeat this! |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 602 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 603 | 4.7 How do I keep user names and passwords secret in Curl command lines? |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 604 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 605 | This problem has two sides: |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 606 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 607 | The first part is to avoid having clear-text passwords in the command line |
| 608 | so that they don't appear in 'ps' outputs and similar. That is easily |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 609 | avoided by using the "-K" option to tell curl to read parameters from a file |
| 610 | or stdin to which you can pass the secret info. curl itself will also |
| 611 | attempt to "hide" the given password by blanking out the option - this |
| 612 | doesn't work on all platforms. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 613 | |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 614 | To keep the passwords in your account secret from the rest of the world is |
| 615 | not a task that curl addresses. You could of course encrypt them somehow to |
| 616 | at least hide them from being read by human eyes, but that is not what |
| 617 | anyone would call security. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 618 | |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 619 | Also note that regular HTTP (using Basic authentication) and FTP passwords |
| 620 | are sent in clear across the network. All it takes for anyone to fetch them |
| 621 | is to listen on the network. Eavesdropping is very easy. Use more secure |
| 622 | authentication methods (like Digest, Negotiate or even NTLM) or consider the |
| 623 | SSL-based alternatives HTTPS and FTPS. |
| Daniel Stenberg | 887e728 | 2001-01-03 09:13:07 +0000 | [diff] [blame] | 624 | |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 625 | 4.8 I found a bug! |
| 626 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 627 | It is not a bug if the behavior is documented. Read the docs first. |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 628 | Especially check out the KNOWN_BUGS file, it may be a documented bug! |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 629 | |
| 630 | If it is a problem with a binary you've downloaded or a package for your |
| 631 | particular platform, try contacting the person who built the package/archive |
| 632 | you have. |
| 633 | |
| Daniel Stenberg | 8eaa7fe | 2002-04-27 18:12:26 +0000 | [diff] [blame] | 634 | If there is a bug, read the BUGS document first. Then report it as described |
| 635 | in there. |
| Daniel Stenberg | 09ba856 | 2000-10-27 12:25:00 +0000 | [diff] [blame] | 636 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 637 | 4.9 Curl can't authenticate to the server that requires NTLM? |
| Daniel Stenberg | 2c10037 | 2000-12-19 07:30:51 +0000 | [diff] [blame] | 638 | |
| Daniel Stenberg | 3a552b1 | 2003-06-26 11:35:48 +0000 | [diff] [blame] | 639 | This is supported in curl 7.10.6 or later. No earlier curl version knows |
| 640 | of this magic. |
| 641 | |
| 642 | NTLM is a Microsoft proprietary protocol. Proprietary formats are evil. You |
| 643 | should not use such ones. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 644 | |
| Daniel Stenberg | bc74375 | 2002-05-15 21:40:29 +0000 | [diff] [blame] | 645 | 4.10 My HTTP request using HEAD, PUT or DELETE doesn't work! |
| 646 | |
| 647 | Many web servers allow or demand that the administrator configures the |
| 648 | server properly for these requests to work on the web server. |
| 649 | |
| 650 | Some servers seem to support HEAD only on certain kinds of URLs. |
| 651 | |
| 652 | To fully grasp this, try the documentation for the particular server |
| 653 | software you're trying to interact with. This is not anything curl can do |
| 654 | anything about. |
| 655 | |
| Daniel Stenberg | 522b85a | 2002-11-12 20:00:02 +0000 | [diff] [blame] | 656 | 4.11 Why does my HTTP range requests return the full document? |
| 657 | |
| 658 | Because the range may not be supported by the server, or the server may |
| 659 | choose to ignore it and return the full document anyway. |
| Daniel Stenberg | bc74375 | 2002-05-15 21:40:29 +0000 | [diff] [blame] | 660 | |
| Daniel Stenberg | 1607711 | 2002-11-20 19:17:43 +0000 | [diff] [blame] | 661 | 4.12 Why do I get "certificate verify failed" ? |
| 662 | |
| 663 | You invoke curl 7.10 or later to communicate on a https:// URL and get an |
| 664 | error back looking something similar to this: |
| 665 | |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 666 | curl: (35) SSL: error:14090086:SSL routines: |
| Daniel Stenberg | 1607711 | 2002-11-20 19:17:43 +0000 | [diff] [blame] | 667 | SSL3_GET_SERVER_CERTIFICATE:certificate verify failed |
| 668 | |
| 669 | Then it means that curl couldn't verify that the server's certificate was |
| 670 | good. Curl verifies the certificate using the CA cert bundle that comes with |
| 671 | the curl installation. |
| 672 | |
| 673 | To disable the verification (which makes it act like curl did before 7.10), |
| 674 | use -k. This does however enable man-in-the-middle attacks. |
| 675 | |
| 676 | If you get this failure but are having a CA cert bundle installed and used, |
| 677 | the server's certificate is not signed by one of the CA's in the bundle. It |
| 678 | might for example be self-signed. You then correct this problem by obtaining |
| 679 | a valid CA cert for the server. Or again, decrease the security by disabling |
| 680 | this check. |
| 681 | |
| 682 | Details are also in the SSLCERTS file in the release archives, found online |
| Daniel Stenberg | 9b6d010 | 2003-02-25 08:36:29 +0000 | [diff] [blame] | 683 | here: http://curl.haxx.se/docs/sslcerts.html |
| Daniel Stenberg | 1607711 | 2002-11-20 19:17:43 +0000 | [diff] [blame] | 684 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 685 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 686 | 5. libcurl Issues |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 687 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 688 | 5.1 Is libcurl thread-safe? |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 689 | |
| Daniel Stenberg | 7d09e51 | 2001-01-11 12:52:07 +0000 | [diff] [blame] | 690 | Yes. |
| 691 | |
| 692 | We have written the libcurl code specificly adjusted for multi-threaded |
| 693 | programs. libcurl will use thread-safe functions instead of non-safe ones if |
| 694 | your system has such. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 695 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 696 | We would appreciate some kind of report or README file from those who have |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 697 | used libcurl in a threaded environment. |
| Daniel Stenberg | 2947010 | 2000-06-02 13:32:01 +0000 | [diff] [blame] | 698 | |
| Daniel Stenberg | a40b55d | 2000-11-22 07:27:26 +0000 | [diff] [blame] | 699 | 5.2 How can I receive all data into a large memory chunk? |
| 700 | |
| Daniel Stenberg | a84af98 | 2001-05-15 13:09:27 +0000 | [diff] [blame] | 701 | [ See also the examples/getinmemory.c source ] |
| 702 | |
| Daniel Stenberg | a40b55d | 2000-11-22 07:27:26 +0000 | [diff] [blame] | 703 | You are in full control of the callback function that gets called every time |
| 704 | there is data received from the remote server. You can make that callback do |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 705 | whatever you want. You do not have to write the received data to a file. |
| Daniel Stenberg | a40b55d | 2000-11-22 07:27:26 +0000 | [diff] [blame] | 706 | |
| 707 | One solution to this problem could be to have a pointer to a struct that you |
| 708 | pass to the callback function. You set the pointer using the |
| 709 | curl_easy_setopt(CURLOPT_FILE) function. Then that pointer will be passed to |
| 710 | the callback instead of a FILE * to a file: |
| 711 | |
| 712 | /* imaginary struct */ |
| 713 | struct MemoryStruct { |
| 714 | char *memory; |
| 715 | size_t size; |
| 716 | }; |
| 717 | |
| 718 | /* imaginary callback function */ |
| 719 | size_t |
| 720 | WriteMemoryCallback(void *ptr, size_t size, size_t nmemb, void *data) |
| 721 | { |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 722 | size_t realsize = size * nmemb; |
| Daniel Stenberg | a40b55d | 2000-11-22 07:27:26 +0000 | [diff] [blame] | 723 | struct MemoryStruct *mem = (struct MemoryStruct *)data; |
| Daniel Stenberg | eea2287 | 2004-03-16 07:56:51 +0000 | [diff] [blame] | 724 | |
| Daniel Stenberg | a40b55d | 2000-11-22 07:27:26 +0000 | [diff] [blame] | 725 | mem->memory = (char *)realloc(mem->memory, mem->size + realsize + 1); |
| 726 | if (mem->memory) { |
| 727 | memcpy(&(mem->memory[mem->size]), ptr, realsize); |
| 728 | mem->size += realsize; |
| 729 | mem->memory[mem->size] = 0; |
| 730 | } |
| 731 | return realsize; |
| 732 | } |
| 733 | |
| Daniel Stenberg | 2c10037 | 2000-12-19 07:30:51 +0000 | [diff] [blame] | 734 | 5.3 How do I fetch multiple files with libcurl? |
| Daniel Stenberg | ec5ac82 | 2000-12-14 08:37:09 +0000 | [diff] [blame] | 735 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 736 | libcurl has excellent support for transferring multiple files. You should |
| 737 | just repeatedly set new URLs with curl_easy_setopt() and then transfer it |
| 738 | with curl_easy_perform(). The handle you get from curl_easy_init() is not |
| 739 | only reusable, but you're even encouraged to reuse it if you can, as that |
| 740 | will enable libcurl to use persistent connections. |
| Daniel Stenberg | a40b55d | 2000-11-22 07:27:26 +0000 | [diff] [blame] | 741 | |
| Daniel Stenberg | bc5954f | 2001-03-23 08:16:24 +0000 | [diff] [blame] | 742 | 5.4 Does libcurl do Winsock initialization on win32 systems? |
| Daniel Stenberg | 910fc85 | 2000-12-30 11:48:51 +0000 | [diff] [blame] | 743 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 744 | Yes, if told to in the curl_global_init() call. |
| Daniel Stenberg | 910fc85 | 2000-12-30 11:48:51 +0000 | [diff] [blame] | 745 | |
| Daniel Stenberg | 7e3cd82 | 2003-12-08 13:59:35 +0000 | [diff] [blame] | 746 | 5.5 Does CURLOPT_WRITEDATA and CURLOPT_READDATA work on win32 ? |
| Daniel Stenberg | 41084e5 | 2001-01-22 08:42:00 +0000 | [diff] [blame] | 747 | |
| 748 | Yes, but you cannot open a FILE * and pass the pointer to a DLL and have |
| Daniel Stenberg | 7e3cd82 | 2003-12-08 13:59:35 +0000 | [diff] [blame] | 749 | that DLL use the FILE * (as the DLL and the client application cannot access |
| 750 | each others' variable memory areas). If you set CURLOPT_WRITEDATA you must |
| 751 | also use CURLOPT_WRITEFUNCTION as well to set a function that writes the |
| 752 | file, even if that simply writes the data to the specified FILE *. |
| 753 | Similarly, if you use CURLOPT_READDATA you must also specify |
| 754 | CURLOPT_READFUNCTION. |
| Daniel Stenberg | 41084e5 | 2001-01-22 08:42:00 +0000 | [diff] [blame] | 755 | |
| Daniel Stenberg | 5d7b32d | 2001-02-04 20:08:42 +0000 | [diff] [blame] | 756 | (Provided by Joel DeYoung and Bob Schader) |
| Daniel Stenberg | 41084e5 | 2001-01-22 08:42:00 +0000 | [diff] [blame] | 757 | |
| Daniel Stenberg | 4c48599 | 2001-04-22 15:45:27 +0000 | [diff] [blame] | 758 | 5.6 What about Keep-Alive or persistent connections? |
| Daniel Stenberg | 6dc5c6f | 2001-01-27 20:51:31 +0000 | [diff] [blame] | 759 | |
| Daniel Stenberg | db5c9cd | 2003-02-25 08:52:32 +0000 | [diff] [blame] | 760 | curl and libcurl have excellent support for persistent connections when |
| 761 | transferring several files from the same server. Curl will attempt to reuse |
| 762 | connections for all URLs specified on the same command line/config file, and |
| 763 | libcurl will reuse connections for all transfers that are made using the |
| 764 | same libcurl handle. |
| Daniel Stenberg | 6dc5c6f | 2001-01-27 20:51:31 +0000 | [diff] [blame] | 765 | |
| Daniel Stenberg | dd82d69 | 2002-10-08 07:16:17 +0000 | [diff] [blame] | 766 | 5.7 Link errors when building libcurl on Windows! |
| 767 | |
| 768 | You need to make sure that your project, and all the libraries (both static |
| 769 | and dynamic) that it links against, are compiled/linked against the same run |
| 770 | time library. |
| 771 | |
| 772 | This is determined by the /MD, /ML, /MT (and their corresponding /M?d) |
| 773 | options to the command line compiler. /MD (linking against MSVCRT dll) seems |
| 774 | to be the most commonly used option. |
| 775 | |
| 776 | (Provided by Andrew Francis) |
| 777 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 778 | 5.8 libcurl.so.3: open failed: No such file or directory |
| 779 | |
| 780 | This is an error message you might get when you try to run a program linked |
| 781 | with a shared version of libcurl and your run-time linker (ld.so) couldn't |
| 782 | find the shared library named libcurl.so.3. |
| 783 | |
| 784 | You need to make sure that ld.so finds libcurl.so.3. You can do that |
| 785 | multiple ways, and it differs somewhat between different operating systems, |
| 786 | but they are usually: |
| 787 | |
| 788 | * Add an option to the linker command line that specify the hard-coded path |
| 789 | the run-time linker should check for the lib (usually -R) |
| 790 | |
| 791 | * Set an environment variable (LD_LIBRARY_PATH for example) where ld.so |
| 792 | should check for libs |
| 793 | |
| 794 | * Adjust the system's config to check for libs in the directory where you've |
| 795 | put the dir (like Linux's /etc/ld.so.conf) |
| 796 | |
| 797 | 'man ld.so' and 'man ld' will tell you more details |
| 798 | |
| Daniel Stenberg | 1d32336 | 2004-08-12 14:09:10 +0000 | [diff] [blame] | 799 | 5.9 How does libcurl resolve host names? |
| 800 | |
| 801 | libcurl includes a number of different name resolve functions: |
| 802 | |
| 803 | - The non-ipv6 resolver that can use one out of four host name resolve calls |
| 804 | (depending on what your system supports): |
| 805 | |
| 806 | A - gethostbyname() |
| 807 | B - gethostbyname_r() with 3 arguments |
| 808 | C - gethostbyname_r() with 5 arguments |
| 809 | D - gethostbyname_r() with 6 arguments |
| 810 | |
| 811 | - The ipv6-resolver that uses getaddrinfo() |
| 812 | |
| 813 | - The c-ares based name resolver that uses the c-ares library for resolves. |
| 814 | |
| 815 | - The Windows threaded resolver. It use: |
| 816 | |
| 817 | A - gethostbyname() on plain ipv4 windows hosts |
| 818 | B - getaddrinfo() on ipv6-enabled windows hosts |
| Daniel Stenberg | dd82d69 | 2002-10-08 07:16:17 +0000 | [diff] [blame] | 819 | |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 820 | 6. License Issues |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 821 | |
| Daniel Stenberg | 1c96128 | 2002-09-03 11:58:18 +0000 | [diff] [blame] | 822 | Curl and libcurl are released under a MIT/X derivate license. The license is |
| 823 | very liberal and should not impose a problem for your project. This section |
| 824 | is just a brief summary for the cases we get the most questions. (Parts of |
| 825 | this section was much enhanced by Bjorn Reese.) |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 826 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 827 | 6.1 I have a GPL program, can I use the libcurl library? |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 828 | |
| Daniel Stenberg | 0d181b5 | 2001-01-04 12:43:53 +0000 | [diff] [blame] | 829 | Yes! |
| Daniel Stenberg | 7d1ef96 | 2000-08-14 06:31:59 +0000 | [diff] [blame] | 830 | |
| Daniel Stenberg | 0d181b5 | 2001-01-04 12:43:53 +0000 | [diff] [blame] | 831 | Since libcurl may be distributed under the MIT/X derivate license, it can be |
| 832 | used together with GPL in any software. |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 833 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 834 | 6.2 I have a closed-source program, can I use the libcurl library? |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 835 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 836 | Yes! |
| Daniel Stenberg | 0d181b5 | 2001-01-04 12:43:53 +0000 | [diff] [blame] | 837 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 838 | libcurl does not put any restrictions on the program that uses the library. |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 839 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 840 | 6.3 I have a BSD licensed program, can I use the libcurl library? |
| Daniel Stenberg | 31b8eea | 2000-08-23 07:27:00 +0000 | [diff] [blame] | 841 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 842 | Yes! |
| Daniel Stenberg | 0d181b5 | 2001-01-04 12:43:53 +0000 | [diff] [blame] | 843 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 844 | libcurl does not put any restrictions on the program that uses the library. |
| Daniel Stenberg | 31b8eea | 2000-08-23 07:27:00 +0000 | [diff] [blame] | 845 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 846 | 6.4 I have a program that uses LGPL libraries, can I use libcurl? |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 847 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 848 | Yes! |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 849 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 850 | The LGPL license doesn't clash with other licenses. |
| Daniel Stenberg | c3318b4 | 2000-08-17 14:06:42 +0000 | [diff] [blame] | 851 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 852 | 6.5 Can I modify curl/libcurl for my program and keep the changes secret? |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 853 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 854 | Yes! |
| Daniel Stenberg | 0d181b5 | 2001-01-04 12:43:53 +0000 | [diff] [blame] | 855 | |
| 856 | The MIT/X derivate license practically allows you to do almost anything with |
| 857 | the sources, on the condition that the copyright texts in the sources are |
| 858 | left intact. |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 859 | |
| Daniel Stenberg | 811edcd | 2004-08-10 08:41:41 +0000 | [diff] [blame] | 860 | 6.6 Can you please change the curl/libcurl license to XXXX? |
| Daniel Stenberg | c3c7739 | 2000-07-31 22:42:34 +0000 | [diff] [blame] | 861 | |
| Daniel Stenberg | c59baa0 | 2001-02-12 10:05:09 +0000 | [diff] [blame] | 862 | No. |
| 863 | |
| Daniel Stenberg | 11d718b | 2001-03-13 11:47:30 +0000 | [diff] [blame] | 864 | We have carefully picked this license after years of development and |
| 865 | discussions and a large amount of people have contributed with source code |
| 866 | knowing that this is the license we use. This license puts the restrictions |
| 867 | we want on curl/libcurl and it does not spread to other programs or |
| Daniel Stenberg | 3a552b1 | 2003-06-26 11:35:48 +0000 | [diff] [blame] | 868 | libraries that use it. It should be possible for everyone to use libcurl or |
| 869 | curl in their projects, no matter what license they already have in use. |